Search Results for "distributed computing"

Multi-Node GPU Training Guide Reveals 72B Model Scaling Secrets

Multi-Node GPU Training Guide Reveals 72B Model Scaling Secrets

Together.ai details how to train 72B parameter models across 128 GPUs, achieving 45-50% utilization with proper network tuning and fault tolerance.

Ray Data and Docling Tackle Enterprise AI's Biggest Pain Point

Ray Data and Docling Tackle Enterprise AI's Biggest Pain Point

New integration combines Ray Data's distributed processing with Docling's document parsing to process 10k+ complex files for RAG applications in hours instead of days.

NVIDIA Launches Open-Source NIXL Library to Speed AI Inference Data Transfers

NVIDIA Launches Open-Source NIXL Library to Speed AI Inference Data Transfers

NVIDIA releases Inference Transfer Library (NIXL), an open-source tool accelerating KV cache transfers for distributed AI inference across major cloud platforms.

Ray 2.55 Adds Fault Tolerance for Large-Scale AI Model Deployments

Ray 2.55 Adds Fault Tolerance for Large-Scale AI Model Deployments

Anyscale's Ray Serve LLM update enables DP group fault tolerance for vLLM WideEP deployments, reducing downtime risk for distributed AI inference systems.

Eigen Labs Launches Project Darkbloom to Turn Idle Macs Into AI Compute Network

Eigen Labs Launches Project Darkbloom to Turn Idle Macs Into AI Compute Network

New research initiative from Eigen Labs aims to route AI inference through underused Apple Silicon machines, claiming 50% cost reduction versus major providers.

Anyscale Launches Agent Skills to Streamline AI on Ray

Anyscale Launches Agent Skills to Streamline AI on Ray

Anyscale's new Agent Skills enhance AI coding tools like Claude Code and Cursor, optimizing Ray-based workflows for speed and scalability.

Ray Serve LLM Enhances Distributed Inference with 24x Boost

Ray Serve LLM Enhances Distributed Inference with 24x Boost

Ray Serve LLM achieves 24x higher throughput with new direct streaming, HAProxy integration, and vLLM backend upgrades, pushing LLM inference forward.

IBM and Verizon Business Collaborate on 5G and AI Edge Computing Innovation

IBM and Verizon Business Collaborate on 5G and AI Edge Computing Innovation

Tech giant IBM is collaborating with Verizon Business to help usher in the future of Industry 4.0 through their respective expertise on edge computing innovation and 5G technology.

Chinese Telecommunications Giant ZTE Collaborates with China Mobile to Publish Blockchain and Edge Computing White Paper

Chinese Telecommunications Giant ZTE Collaborates with China Mobile to Publish Blockchain and Edge Computing White Paper

Chinese multinational telecommunications giant ZTE has partnered with China Mobile, along with the Chinese Ministry of Industry and Information Technology Laboratory, and Peking University to publish a “blockchain and edge computing whitepaper.”

IOTA On How Distributed Ledger Technology Will Transform Supply Chain

IOTA On How Distributed Ledger Technology Will Transform Supply Chain

Distributed ledger technology could potentially revolutionize the supply chain industry by providing several upgrades, according to industry experts.

Will Distributed Ledger Technology Revolutionize Education?

Will Distributed Ledger Technology Revolutionize Education?

Since the establishment of blockchain and its deliverance of many opportunities for with disruptive potentials, the question at the back of many minds have been numerous, this article is focused on answering some of those pressing questions.

Brazil Highlights Blockchain Technology as a Digital Strategy Goal

Brazil Highlights Blockchain Technology as a Digital Strategy Goal

Last week, Brazil unveiled its Digital Government Strategy that highlighted the use of distributed ledger systems and blockchain technology to transform major parts of the economy, especially in a post-COVID-19 environment.

Trending topics